TEACh: Task-Driven Embodied Agents That Chat

نویسندگان

چکیده

Robots operating in human spaces must be able to engage natural language interaction, both understanding and executing instructions, using conversation resolve ambiguity correct mistakes. To study this, we introduce TEACh, a dataset of over 3,000 human-human, interactive dialogues complete household tasks simulation. A Commander with access oracle information about task communicates Follower. The Follower navigates through interacts the environment varying complexity from "Make Coffee" "Prepare Breakfast", asking questions getting additional Commander. We propose three benchmarks TEACh embodied intelligence challenges, evaluate initial models' abilities dialogue understanding, grounding, execution.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Papetto: Embodied Co-Presence in Video Chat

In this paper, we describe Papetto, a lightweight robotic arm that moves according to face detection techniques in order to mirror facial movements such as head shaking, leaning and tilting. Using this system we examine the role of the “frame” in video chat and how embodied co-presence is defined and bounded through lightweight robotic mirroring to enable new forms of engagement in remote commu...

متن کامل

Evaluating Data-Driven Style Transformation for Gesturing Embodied Agents

This paper presents an empirical evaluation of a method called Style transformation which consists of modifying an existing gesture sequence in order to obtain a new style where the transformation parameters have been extracted from an existing captured sequence. This data-driven method can be used either to enhance key-framed gesture animations or to taint captured motion sequences according t...

متن کامل

Building Neuromorphic Embodied Cell Assembly Agents that Learn

Neuromorphic embodied cell assembly agents that learn are one application being developed for the Human Brain Project (HBP). The HBP will build tools, available for all researchers, for building brain simulations. Existing simulated neural agents will be translated to the platforms provided by the HBP; these agents will then run on neuromorphic chips instead of a von Neumann based computer. The...

متن کامل

Can You Teach an Old Dog New Tricks? How Older Adults Perceive Embodied Agents

In this experiment we investigate how older adults perceive an embodied agent as compared to younger people in the context of an information giving task. Our results show that older adults found the agent less friendly and likeable than the younger participants in our experiment, and that they had a strong preference for a human presenter. However, the older adults were relatively positive on s...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2022

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v36i2.20097